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SUMMARY 


A.  Problem 


The  purpose  of  this  research  is  to  evaluate  the  effectiveness  of 
the  area  (homogeneous)  scales  of  the  Navy  Vocational  Interest  Inventory 
^NVII)  as  predictors  of  Class  "A"  school  achievement  and  as  measures  of 
“rating  differentiation. 

B,  Background 

In  earlier  research,  empirically  derived  NVII  occupational  keys  were 
found  to  differentiate  effectively  between  men  in  various  Class  "A" 
schools  on  the  basis  of  interest  scores,  and  to  contribute  significantly 
toward  the  prediction  of  school  achievement.  The  present  research 
-^compares  the  effectiveness  of  the  specific  occupational  scales  with  more 
general  interest  measures--the  NVH  area  scales--in  predicting  these 
criteria. 


IX,  Approach 


The  NVII  was  administered  experimentally  to  samples  of  incoming 
--^■students  at  six  Class  "A"  schools  varying  widely  in  curriculum  and  to  a 
^^ample  of  students  in  the  Submarine  School.  In  addition  to  NVII  area 
scales,  scores  on  Basic  Test  Battery  (BTB)  subtests  were  available  for 
IrJmen  in  each  school.  Multiple  correlations  were  computed,  thus  allowing 
^iValidity  comparisons  of  the  P'*'E  in  predicting  Class  "A"  school  achievement 
t,:fo  be  made  with  and  without  the  addition  of  NVII  area  scales.  These 


multiples  were  compared  to  multiples  obtained  using  occupational  key 
scores.  Average  area  scale  profiles  of  the  various  occupational  groups 
were  compared  to  those  obtained  using  occupational  key  profiles. 


D.  Findings,  Conclusions,  and  Recommendations 


The  area  scales  were  found  to  be  as  effective  as  occupational  scales 
in  differentiating  the  interest  patterns  of  men  in  various  schools 
^page  5).  The  area  scales  were  also  found  to  contribute  significantly 
to  the  prediction  of  Class  "A"  school  achievement  (page  5} .  It  was 
■concluded  that  the  differences  between  Che  two  types  of  scales  were  not 
substantial. 
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AREA  SCALES  OF  THE  NAVY  VOCATIONAL  INTEREST  INVENTORY 
AS  PREDICTORS  Ol-  SCHOOL  PERFORMANCE  AND 
RATING  ASSIGNMENT 


A.  PURPOSE  AND  BACKGROUND 

As  part  of  a  program  to  evaluate  non-cognit i ve  tests  for  use  in 
recruit  classification,  the  Navy  Vocational  Interest  Inventory  (NVII) 
was  recently  vali'^»*'e>i  apainst  Class  "A"  school  acl^iev'^ment  and  analyzed 
for  its  ability  to  differentiate  men  in  various  ratings  (Abrahams,  Lau, 
Neumann,  1968).  It  was  found  that  the  19  empirically  derived 
occupational  keys  developed  by  Clark  (1953)  effectively  differentiated 
men  in  various  Class  "A"  schools  on  the  basis  of  interest  scores. 
Occupational  keys  were  also  found  to  contribute  significantly  toward 
the  prediction  of  Class  "A"  school  achievement.  These  findings  were 
in  agreement  with  earlier  reports  (Clark,  1955;  Clark,  1961;  Albitz, 

1958;  Spies,  1966). 

Clark  developed  these  occupational  keys  on  the  basis  of  how  well 
they  d  '^ferentiated  between  the  interests  of  men  in  a  general  reference 
group  .*nd  criterion  groups  of  men  who  were  members  of  specific  Navy 
ratings.  A  key  was  consiaered  effective  if  the  items  within  it 
successfully  separated  men  in  the  criterion  group  from  mei  in  the 
reference  group.  The  scores  that  a  man  earns  on  the  occupational  keys 
indicate  the  degree  to  which  his  interests  resemble  those  of  men  in 
various  Navy  ratings.  Although  it  is  justifiable  to  say  that  a  man  who 
scores  high  on  the  Hospitalman  (HM)  key  has  interests  like  rated  lIMs, 
one  of  the  shortcomings  of  occupational  keys  is  the  difficulty  in 
making  any  generalizations  about  the  underlying  trait  structure  of 
V.nterest  patterns.  Another  shortcoming  is  the  amount  of  work  necessary 
to  construct  and  score  keys  for  all  of  the  Navy  schools.  Some 
occupat ional  keys  have  substantial  correlations  wiili  others,  and 
consequently  it  may  be  possible  to  describe  the  essential  variation  in 
patterns  of  interest  scores  by  use  of  a  smaller  number  of  keys.^ 

To  alleviate  these  shortcomings,  Clark  developed  homogeneous,  or 
area  scales,  by  identifying  clusters  of  items  that  were  related  to  one 
another.  The  advantage  of  these  scales  is  that  they  draw  together  items 
with  a  common  core  into  homogeneous  groupings,  thus  providing  relatively 
"pure"  indicators  of  traits  or  factors  measured  by  the  NVII.  The  nine 
area  scales  developed  by  Clark  include  Mechanical,  Health  Service,  Office 


^To  some  degree,  this  was  accomplished  when  Clark  reduced  the  number 
of  occupational  keys  from  19  to  13  by  deleting  keys  when  they  were  ^  i 

highly  related  to  other  keys.  ^  i 
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Work,  tlcctronics,  Food  Service,  Carpentry,  Sales-Office,  Clean  Hands, 
and  Outdoors.  A  brief  description  of  each  scale  is  presented  in  the 
Appendix . 

Although  several  attempts  have  been  made  to  predict  Class  "A"  school 
achievement  using  occupational  keys,  no  studies  have  utilized  area 
scales  for  predicting  this  criterion.  The  purjiose  of  this  report  is  to 
validate  the  area  scales  against  Class  "A"  scliool  achievement  and  to 
compare  their  validity  with  occupational  keys.  In  addition,  area 
scales  are  analyzed  for  their  ability  to  differentiate  the  interest 
patterns  of  men  in  different  ratings. 


B.  PROCEDURE 

In  1964  and  1965,  the  NVII  was  administered  to  recruits  at  six 
different  Class  "A"  schools  prior  to  the  beginning  of  training.  These 
six  schools  were  Hospitalman  (HM) ,  Electronics  Technician  (ET) ,  Yeoman 
(YN) ,  Storekeeper  (SK) ,  Engineman  (EN) ,  and  Machinist's  Mate  (MM).  In 
addition,  the  test  was  administered  to  a  sample  of  recruits  in  the 
Submarine  School.  NVII  scores  were  obtained  on  the  nine  area  scales. 

In  addition  to  NVII  scores,  scores  on  the  Basic  Test  Battery  (BTB)  sub¬ 
tests  and  Final  School  Grades  (FSG)  were  obtained  for  men  in  each  school. 
An  intercorrelation  matrix  was  computed  for  each  school.  Three  multiple 
regression  analyses  were  completed  for  each  school.  The  first  analysis 
involved  only  the  nine  NVII  area  scales;  the  second  included  only  BTB 
scores,  and  the  third  included  both  BTB  and  NVII  scores.  From  these 
analyses,  multiple  correlations  for  various  composites  were  computed, 
thus  allowing  validity  comparisons  with  and  without  the  NVII  scales. 

In  addition,  mean  profiles  on  all  area  scales  for  men  in  each  school 
Were  developed.  This  permitted  an  evaluation  of  the  area  scales'  ability 
to  discriminate  similarities  and  differences  in  measured  interests  that 
characterized  recruits  in  the  various  schools. 


C.  RESULTS  AND  DISCUSSION 


1.  NVII  Validity 

a.  Individual  scales.  Table  1  presents  area  scale  means,  standard 
deviations,  and  correlations  with  FSG  for  all  NVII  scales  within  each 
school.  On  the  scales  judged  to  be  most  relevant  for  each  school, 
correlations  ranged  from  .06  to  .31,  with  a  median  correlation  of  .15. 
In  only  the  HM  and  SK  schools,  however,  was  the  scale  judged  to  be  most 
relevant  the  best  single  predictor  of  FSG. 

b.  Combined  NVII  area  scales.  Table  2  presents  the  resuits  of 
seven  multiple  regression  analyses,  one  for  each  school,  using  all  NVII 
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K\  U  Ar<a  Seal?  Mean*;,  f^tamiard  ('f*viat  ,  and  Corrclatinrs  With  Final  School  f.rade  by  Rating 


Correlation**  brt^-ecn  5calc^  judsed  m.-'s?  rclovant  -mO  Final  School  Oadr  for  each  school  are  undrrlined 


TABLE  2 


Combined  NVTI  Area  Scales  Versus  Best  Single  NVIl  Area  Scale 
Validity  for  Each  School  in  Predicting 
Final  School  Grade 


School 

N 

Best  Single 
NVII  Area 
Scale 

NVII 

Area  Scale 
Multiple 

Absolute 

Increase 

a 

P 

(HM)  Hospitalman 

239 

.31  (Healthj^ 
Service) 

.37 

.06 

.01 

(ET)  Electronics 
Technician 

97 

-.22  (Carpen¬ 
try) 

.27 

.05 

N.S." 

(YN)  Yeoman 

93 

-.IS  (Mechan¬ 
ical) 

.21 

.06 

N.S. 

(SK)  Storekeeper 

77 

.23  (Office 
Work) 

.42 

.19 

.01 

(EN)  Engineman 

94 

-.25  (Office 
Work) 

.28 

.03 

N.S. 

(MM)  Machinist's  Mate 

75 

-.26  (Office 
Work) 

.55 

.09 

.05 

Submarine 

168 

-.I"”  fOffice 
Work) 

.:.i 

.  10 

.01 

Notes  -- 

Significance  of  increase  was  determined  between  single  scale 
validity  and  R's  based  upon  more  than  one  scale  (McNemar,  1960,  p.  279). 

^Scale  names  in  parentheses  indicate  the  scale  on  which  validity 
is  based. 

^N.S.  indicates  non-significant  increase. 
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Cv-ales  in  combination,  ihese  multiples  are  compared  to  the  validities 
of  the  single  most  valid  scales  which,  as  noted  above,  were  generally 
not  the  scales  judged  most  relevant  for  that  school. 

The  correlation^  between  the  best  single  scales  and  FSG  ranged 
from  .15  to  .31,  with  a  median  of  .23.  Combining  additional  scales 
significantly  increased  the  correlation  with  FSG  over  that  found  with 
the  best  single  scale  in  the  HM,  SK,  MM,  and  Submarine  schools.  Thjse 
multiple  correlations  ranged  from  .21  for  the  YN  School  to  .42  for  the 
SK  School,  with  a  median  correlation  of  .28.  Composites  produced  a 
median  increase  of  .06  correlation  points  over  the  best  smgle  scale. 

2.  BTB  Plus  NVII  Scales 


Table  3  shows  the  results  for  each  school  when  BTB  scores  and  NVII 
area  scales  were  combined  to  predict  FSG.  The  basic  question  is  how 
much  the  NVII  scales  can  supplement  BTB  measures  in  the  multiple 
regression  equations. 

With  only  one  exception,  that  of  the  YN  School  sample,  NVII  area 
scales  contributed  significantly  toward  the  prediction  of  FSG.  Significant 
increases  ranged  from  .02  in  both  the  EN  and  Submarine  schools  to  .19 
correlation  points  for  the  SK  School  sample.  When  area  NVII  scores  were 
added  to  BTB  scores,  the  median  increase  was  .04  correlation  points. 

3.  Occupational  Versus  Area  NVI I  Scales 

With  reference  as  to  whether  area  scales  or  occupational  keys 
provided  more  effective  prediction  of  FSG,  the  results  indicated  that 
a  composite  of  occupational  keys  yielded  somewhat  higher  median  multiple 
correlations  with  FSG  CR' s  =  .56  versus  .28).^  However,  there  were  no 
substantial  differences  between  the  validities  of  the  area  scales  judged 
to  be  most  relevant  for  each  school  and  the  validities  of  the  empirically 
constructed  relevant  keys.  There  were  also  no  substantial  differences 
between  the  validities  of  the  single  most  valid  area  scales  and  the 
single  most  valid  occupational  keys.  Further,  when  area  and  occupational 
scores  were  combined  with  BTB  scores,  the  median  increase  in  both  cases 
was  .04  correlation  points. 

Relevant  occupational  and  area  scales  were  compared  on  their  ability 
to  separate  men  in  the  various  schools.  This  was  done  by  computing  for 
each  type  scale  the  amount  of  overlap  between  scores  that  men  in  each 
school  earned  on  their  own  relevant  scale  and  the  scores  earned  by  men 
in  Che  other  schools  on  the  same  scale.  For  example,  men  in  the  EN 
School  earned  a  mean  score  of  58.34  on  the  EN  key  and  men  in  the  ET  School 


The  lesults  on  the  validity  of  occupational  keys  are  abstracted 
from  an  earlier  report  (Abrahams,  Lau,  8  Neumann,  1968). 


S  1 
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TABLE  3 


BTB  Validity  Versus  Combined  BTB-NVII  Validity  for  Each 
School  in  Predicting  Final  School  Grade 


BTB 

NVII-BTB 

a 

P 

School 

N 

Multiple 

Multiple 

Increase 

(HM)  Hospitalman 

232 

.54 

.58 

.04 

.01 

(ET)  Electronics  Technician 

97 

.38 

.44 

.06 

.05 

(YN)  Yeoman 

93 

.51 

.31 

N.S.^ 

(SK)  Storekeeper 

77 

.30 

.49 

.  19 

.01 

(EN)  Engineman 

94 

.66 

.68 

.02 

.05 

(MM)  Machinist's  Mate 

73 

.49 

.59 

.10 

.05 

Submarine 

168 

.48 

.50 

.02 

.06 

ilotes  -- 

Significance  of  increase  was 

determined 

between 

single  scale 

validity  and  R's  based  upon 

more  than 

one  scale 

(McNemar , 

1960, 

p.  279). 

'^N.S.  indicates  non-significant  increase. 
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a  score  of  48.18  on  the  EN  key.  The  overlap  between  the  score  distributions 
was  50  per  cent.  On  the  Mechanical  area  scale,  ENs  earned  a  mean  score 
of  16.4  and  ETs  a  mean  score  of  12.5,  the  overlap  being  77  per  cent.  In 
this  case,  the  empirical  EN  key  was  more  effective  in  differentiating 
the  interests  of  ETs  and  ENs  than  the  relevant  Mechanical  area  scale. 

In  general,  it  was  found  that  relevant  occupational  keys  were  somewhat 
more  effective  than  relevant  area  scales,  particularly  in  closely  related 
mechanical  or  technical  activities.  This  is  probably  because  of  the 
fine  distinctions  between  these  ratings  which  make  it  difficult  to 
develop  area  scales  which  will  classify  men  in  closely  related  occupations 
as  well  as  occupational  keys.  On  the  other  hand,  area  scales  appeared 
to  be  somewhat  more  effective  than  occupational  keys  in  separating  men 
in  unrelated  schools  such  as  ETs  and  llMs.  When  relevant  scales  were 
compared  over  all  schools,  there  were  no  differences  between  the  two 
types  of  scales. 

4 .  Rating  Differentiation 

Figures  1  through  3  present  the  mean  profile  on  all  area  scales  for 
each  school.  These  profiles  are  arranged  to  emphasize  the  similarities 
and  differences  that  characterize  men  in  each  of  the  seven  schools.  In 
each  school,  men  earned  their  highest  scores  on  the  scale  judged  most 
relevant  for  that  school. 

Figure  1  shows  that  the  interest  patterns  of  YNs  and  SKs  were  very 
similar,  with  both  groups  earning  their  highest  scores  on  the  Office 
Work  scale.  Figure  2  shows  marked  differences  between  the  responses  of 
ETs  and  (Ws,  with  ETs  earning  their  highest  scores  on  the  Mechanical 
and  Electronics  scales,  and  HMs  earning  their  highest  scores  on  the 
Health  Service  scale.  When  the  responses  of  HMs  were  compared  to  YNs 
and  SKs,  there  were  substantial  differences  between  the  samples  on  the 
Health  Service  and  Office  Work  scales.  With  the  exception  of  scores  on 
the  Electronics  scale,  the  responses  of  ETs  overlapped  those  of  MMs, 

ENs,  and  men  in  the  Submarine  School. 

Figure  3  indicates  that  the  interest  patterns  of  men  in  the  Submarine, 
MM,  and  EN  schools  are  very  similar,  with  all  three  samples  earning 
their  highest  scores  on  the  Mechanical  scale.  There  was  very  little 
overlap  between  the  responses  of  men  in  these  three  schools  with  men  in 
the  YN,  SK,  or  HM  schools. 

These  profiles  indicated  that  NVIl  area  scale  scores  effectively 
differentiated  among  men  in  these  school  samples,  and  emphasized  the 
fact  that  real  differences  in  interest  patterns  existed  among  these  groups. 
Area  scores  provided  a  somewhat  clearer  picture  of  the  nature  of 
differences  in  group  interest  patterns  than  occupational  keys,  but  these 
profiles  parallel  those  reported  in  an  earlier  study  where  NVII  occupational 
key  profiles  were  presented  (Abrahams,  Lau,  6  Neumann,  1968). 
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Figure  1.  Mean  NVII  Area  Profiles  on  all  Scales  for  Yeoman  (YN) 
and  Storekeeper  (SK)  School  Samples. 
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Figure  2.  Mean  NVII  Area  Profiles  on  all  Scales  for 
liospitalman  (ilM)  and  Flectronics  Technician  (CT)  School  Sample 


mechanical 


health  service 


OFFICE  WONK 


CLCCTNONICS 


FOOD  SEfIVICe 


CAftPENTRV 


$ALeS«.OFFICe 


CLEAN  HANDS 


outdoors 


Not#  .... 

9  T«bl«  FfttriFt  in  row  tcgl*  vnit» 
b  Profile  ^  Fcolg  most  rtUvont  tq  tgch  tumpU 
indicotgd  by  circlg  :0 

Figure  3.  Mean  NVII  Area  Profiles  on  all  Scales  for  Machinist's 
Mate  (MM),  Engineman  (EN),  and  Submarine  School  Samples. 


D.  CONCLUSIONS 


NVII  area  scales  were  found  to  be  significantly  related  to  Class  "A" 
school  achievement.  Correlations  between  scales  judged  most  relevant 
ranged  from  .06  to  .31,  with  a  median  correlation  of  .15.  In  general, 
combining  several  area  scales  into  composites  significantly  improved 
prediction. 

When  area  scales  were  combined  with  BTB  scores,  significant  increases 
were  obtained  for  all  but  the  YN  School  sample.  The  median  increase 
was  .04  correlation  points. 

With  reference  to  the  effectiveness  of  occupational  and  area  scales 
in  predicting  school  achievement,  it  was  concluded  that  the  differences 
between  the  two  types  of  scales  were  not  substantial,  and  that  both 
contributed  significantly  toward  the  prediction  of  achievement. 

In  general,  the  NVII  area  scales  were  as  effective  as  occupational 
keys  in  differentiating  among  the  interest  patterns  of  men  in  the 
various  school  samples.  Since  the  area  scales  provide  easily 
interpretable  and  relatively  "pure"  scores  on  nine  interest  factors, 
it  would  appear  that  these  scores  might  be  better  suited  for  recruit 
classification  than  scores  on  the  occupational  keys. 
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APPENDIX 


The  following  paragraphs  describe  the  content  of  each  of  the  nine  NVII 
area  scales. 

Mechanical 

These  items  are  about  mechanical  things,  machine  operation  and  design, 
or  home  repairs  of  mechanical  and  electrical  gadgets. 

Health  Service 

This  scale  shows  interests  in  medical  and  hospital  service,  or  in 
working  in  medical  or  chemical  laboratories. 

Office  Work 

This  scale  shows  interests  in  clerical  work,  office  machines, 
bookkeeping  and  accounting,  or  in  office  management. 

Electronics 

These  items  deal  with  the  building  and  operation  of  radio  and  other 
electronic  equipment. 

Food  Service 

These  items  are  concerned  mainly  with  menu  planning  and  preparing  food. 
Carpentry 

This  cluster  deals  with  carpentry  and  furniture  making.  Some  items 
show  a  dislike  for  electrical-electronics  or  medical-chemical 
activities . 

Sales-Office 

Two  clusters  are  covered  by  these  items.  The  largest  deals  with 
speaking  and  writing;  the  other  indicates  interests  in  art  and  music. 
Other  items  show  an  interest  in  people;  some  show  socially  accepted, 
"highly  thought  of"  activities. 

Clean  Hands 

There  is  no  simple  theme  in  these  items.  They  seem  to  measure  one's 
preference  for  "clean  hands"  activities. 

Outdoors 

Most  items  in  this  scale  show  interests  in  athletics  and  outdoor 
activities.  A  second  group  deals  with  unskilled  manual  jobs  and 
home  repairs.  They  indicate  dislike  of  feminine,  indoor,  verbal, 
and  complex  tasks. 
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The  purpose  of  this  research  is  to  evaluate  the  effectiveness  of  the  area 
(homogeneous)  scales  of  the  Navy >Vocational  Interest  -Inventory  (NVII)  asjpredictors 
of  Class  "A^  school  achievement  and  as  measures  of  rating  differentiation^ 

In  earlier  research,  empirically  derived  NVII  occupational  keys  were  found  to 
differentiate  effectively  between  men  in  various  Class  "A"  schools  on  the  basis  of 
interest  scores,-  and  to  contribute  significantly  toward  the  prediction  of  school 
achievement.  Cthe  research  compares  the  effectiveness  of  the  specific 

occupational  scales  with  more  general  interest  measures--the  NVII  area  scales--in 

predicting  these  criteria.  :  . 

'  The  NVII  was  administered  experimentally  to  samples  of  incoming  students  at  six 
Class  "A”^  schools  varying  widely  in  curriculum  and  to  a  sample  of  students  in  the 
Submarine  School.  -T^n-addition  to  NVII  area  scales,  scores  on  Basic  Test  Battery  (BTB) 
subtests  were  available  for  men  in  each  school.  Multiple  correlations  were  computed, 
thus  allowing  validity  comparisons^ of  the  BTB  in  predicting  Class  "A"  school 
achievement  to  be  made  with  and  witR^Kit  the  addition  of  NVII  area  scales.  These 
multiples  were  compared  to  multiples  oVained  using  occupational  key  scores.  Average 
area  scale  profiles  of  the  various  occupational  groups  were  compared  to  those 
obtained  using  occupational  key  profiles. 

The  area  scales  were  found  to  be  as  effective  as  occupational  scales  in 
differentiating  the  interest  patterns  of  men  in  various  schools.  The  area  scales  were 
also  found  to  contribute  significantly  to  the  prediction  of  Class  "A"  school 
achievement.  It  was  concluded  that  the  differences  between  the  two  types  of  scales 
were  not  substantial 
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